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DETAILED ACTION 
Remarks 

1 . In response to communications filed on July 22, 2004, claims 42-46 have 
been cancelled and claims 1-41 are presently pending in the application. 

Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 
U.S.C. 102 that form the basis for the rejections under this section made in this 
Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in 
public use or on sale in this country, more than one year prior to the date of application for patent in 
the United States. 

3. Claims 1-9, 12-26 and 29-34 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Bhandari et al. (U.S. Patent No. 5,865,464). 

As to claim 1 , Bhandari et al. teaches a method of organizing media 
objects in a database (See column 2, lines 50-59, where "organizing media 
objects" is read on "'smart' archival and retrieval system"), comprising: 
capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 
26-29, where "capturing a media object" is read on "images are input"); 
detecting attributes of the media object indicated in metadata for the media 
object (See column 4, lines 30-37; column 6, lines 4-20); 
identifying media objects stored in the database that are related to the media 
object (See column 4, lines 30-37; column 6, lines 1-8); 
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inferring organization information for the media object based upon information 
obtained from each of the stored media objects that are related to the media 
object (See column 6, lines 16-24, where "inferring organization information" is 
read on "frame"); and 

organizing the media object in the database based upon the inference (See 
column 6, lines 22-25, lines 40-41). 

As to claims 2 and 19, Bhandari et al. teaches wherein the detecting step 
comprises: 

detecting attributes of the media object generated when the media object 
was captured (See column 4, lines 26-37; column 6, lines 4-20). 

As to claims 3 and 20, Bhandari et al. teaches assigning at least one 
attribute to the metadata for the media object prior to storing the media object 
(See column 4, lines 30-37, where "storing" is read on "processed"; and see 
column 6, lines 16-20). 

As to claims 4 and 21 , Bhandari et al. teaches assigning at least one 
attribute to the metadata for the media object based upon the inference (See 
column 5, lines 52-58, where "inference" is read on "tag"). 



As to claims 5 and 22, Bhandari et al. teaches detecting common features 
of the stored media objects (See column 4, lines 30-37; column 6, lines 1-8; 
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column 6, lines 62-63, where "feature" is read on "role matches" and " weight"; 
and see column 10, lines 12-17); 

identifying the stored media objects that have common features (See column 4, 
lines 30-37; column 6, lines 1-8; column 6, lines 62-63, where "identifying" is read 
on "matching" and where "feature" is read on "role matches" and " weight"; and 
see column 10, lines 12-17); and 

eliminating the stored media objects that are not identified prior to inferring 
the organizing information (See column 7, lines 6-12; lines 36-41). 

As to claims 6 and 23, Bhandari et al. teaches adding information to the 
attributes of the metadata of the media object based upon the common features 
of the stored media objects (See column 4, lines 30-37; column 6, lines 1-8; 
column 6, lines 62-63, where "feature" is read on "role matches" and " weight"; 
and see column 10, lines 12-17). 

As to claims 7-8, 24 and 25, Bhandari et al. teaches adding information to 
the metadata of the media object indicating that the organization information for 
the media object was determined based upon an inference (See column 4, lines 
30-37; column 5, lines 53-58; column 6, lines 1-8; lines 62-63; column 10, lines 
12-17). 
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As to claim 9, Bhandari et al. teaches a method of organizing media 
objects in a database (See column 2, lines 50-59, where "organizing media 
objects" is read on "'smart 1 archival and retrieval system"), comprising: 
capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 
26-29, where "capturing a media object" is read on "images are input"); 
determining attributes of the media object indicated in metadata for the media 
object (See column 4, lines 30-37; column 6, lines 4-20); 
determining a date on which the media object was captured, wherein the date 
comprises one of the attributes of the media object (See column 4, lines 30-37, 
where "date" is read on "when image was taken"; and see column 6, lines 1-8); 
comparing the date with threshold date information (See column 6, lines 62-67; 
column 7, lines 1-5); 

identifying media objects stored in the database that are related to the media 
object based upon the comparison (See column 4, lines 30-37; column 6, lines 1- 
8); 

inferring organization information for the media object based upon information, 
obtained from each of the stored media objects related to the media object, and 
organizing the media object in the database based upon the inference (See 
column 6, lines 16-24, where "inferring organization information" is read on 
"frame"; and see lines 22-25, lines 40-41). 
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As to claim 12, Bhandari et al. teaches a method of organizing media 
objects in a database (See column 2, lines 50-59, where "organizing media 
objects" is read on "smart' archival and retrieval system"), comprising: 
capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 
26-29, where "capturing a media object" is read on "images are input"); 
detecting attributes of the media object indicated in metadata for the media 
object (See column 4, lines 30-37; column 6, lines 4-20); 
performing an inexact search of the database based upon at least one of the 
attributes of the media object to identify media objects stored in the database that 
are related to the media object (See column 4, lines 30-37; column 6, lines 1-8; 
column 7, lines 36-41); 

inferring organization information for the media object based upon information 
obtained from each of the stored media objects that are related to the media 
object (See column 6, lines 16-24, where "inferring organization information" is 
read on "frame", lines 22-25, lines 40-41); and 

organizing the media object in the database based upon the inference (See 
column 6, lines 22-25, lines 40-41). 

As to claims 13 and 30, Bhandari et al. as modified, teaches wherein the 
inexact logic search step comprises: 

performing an inexact search of the database based upon a date on which the 
media object was captured, wherein the date comprises one of the attributes of 
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the media object (See Bhandari et al. , column 4, lines 30-37; column 6, lines 16- 
25; column 7, lines 36-41). 

As to claims 14 and 31 , Bhandari et al. as modified, teaches wherein the 
inexact logic search step comprises: 

performing an inexact search of the database based upon a location at which the 
media object was captured, wherein the location comprises one of the attributes 
of the media object (See Bhandari et al. , column 2, lines 21-22; column 4, lines 
30-37; column 5, lines 19-21; column 6, lines 16-25; column 7, lines 36-41). 

As to claim 15, Bhandari et al. teaches a method of organizing media 
objects in a database (See column 2, lines 50-59, where "organizing media 
objects" is read on "'smart' archival and retrieval system"), comprising: 
capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 
26-29, where "capturing a media object" is read on "images are input"); 
comparing the media object with media objects that are stored in the database 
(See column 6, lines 62-63; column 10, lines 12-14, where "feature" is read on 
"object description"); 

identifying the stored media objects in the database that include features in 
common with the media object (See column 4, lines 30-37; column 6, lines 1-8; 
column 6, lines 62-63, where "identifying" is read on "matching"); 
inferring organization information for the media object based upon information, 
obtained from each of the media objects including features in common with the 
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media object, representing organization in the database (See column 6, lines 16- 
24, where "inferring organization information" is read on "frame"); and 
organizing the media object in the database based upon the inference (See 
column 6, lines 22-25, lines 40-41). 

As to claim 16, Bhandari et al. teaches a method of organizing media 
objects in a database (See column 2, lines 50-59, where "organizing media 
objects" is read on "'smart' archival and retrieval system"), comprising: 
capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 
26-29, where "capturing a media object" is read on "images are input"); 
identifying a feature of the media object (See column 4, lines 30-37; column 6, 
iines 1-8; column 6, lines 62-63, where "identifying" is read on "matching" and 
where "feature" is read on "role matches" and " weight"); 
comparing the feature of the media object with stored media objects that are 
stored in the database (See column 6, lines 62-63; column 10, lines 12-14, where 
"feature" is read on "object description"); 

identifying the stored media objects having the feature (See column 6, lines 1-8; 
column 6, lines 62-63, where "identifying" is read on "matching" and where 
"feature" is read on "role matches" and " weight"; and see column 10, lines 12- 
17); 

inferring organization information for the media object based upon information 
obtained from each of the stored media objects having the feature found in the 
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media object (See column 6, lines 16-24, where "inferring organization 
information" is read on "frame"); and 

organizing the media object in the database based upon the inference (See 
column 6, lines 22-25, lines 40-41 ). 

As to claim 17, Bhandari et al. teaches a method of organizing media 
objects in a database (See column 2, lines 50-59, where "organizing media 
objects" is read on "'smart' archival and retrieval system"), comprising: 
capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 
26-29, where "capturing a media object" is read on "images are input"); 
identifying a feature of the media object (See column 6, lines 62-63, where 
"identifying" is read on "matching" and where "feature" is read on "role matches" 
and " weight"); 

performing an inexact search to detect stored media objects that are stored in the 
database having the feature identified in the media object (See column 4, lines 
30-37; column 6, lines 4-20); 

identifying the media objects having the feature identified in the media object 
(See column 4, lines 30-37; column 6, lines 1-8; column 6, lines 62-63, where 
"identifying" is read on "matching" and where "feature" is read on "role matches" 
and " weight"; and see column 10, lines 12-17); 

inferring organization information for the media object based upon in formation 
obtained from each of the stored media objects having the feature identified in 
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the media object (See column 6, lines 16-24, where "inferring organization 
information" is read on "frame"); and 

organizing the media object in the database based upon the inference (See 
column 6, lines 22-25, lines 40-41). 

As to claim 18, Bhandari et al. teaches a computer-readable medium 
having computer-executable instructions (See column 2, lines 40-44, where 
"computer-executable instructions" is read on "computer program") for performing 
the steps of: 

capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 

26-29, where "capturing a media object" is read on "images are input"); 

detecting attributes of the media object indicated in metadata for the media 

object (See column 4, lines 30-37; column 6, lines 4-20); 

identifying media objects stored in the database that are related to the media 

object (See column 4, lines 30-37; column 6, lines 1-8); 

inferring organization information for the media object based upon information 

obtained from each of the stored media objects that are related to the media 

object (See column 6, lines 16-24, where "inferring organization information" is 

read on "frame"); and organizing the media object in the database based upon 

the inference (See column 6, lines 22-25, lines 40-41). 



As to claim 26, Bhandari et al. teaches a computer-readable medium 
having computer-executable instructions (See column 2, lines 40-44, where 
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"computer-executable instructions" is read on "computer program") for performing 
the steps of: 

capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 
26-29, where "capturing a media object" is read on "images are input"); 
determining attributes of the media object indicated in metadata for the media 
object (See column 4, lines 30-37, where "attributes" is read on "description"; and 
see column 6, lines 1-8); 

determining the date on which the media object was captured, wherein the date 
comprises one of the attributes of the media object (See column 4, lines 30-37, 
where "attributes" is read on "description"; and see column 6, lines 1-8); 
comparing the date with threshold date information (See column 6, lines 62-67; 
column 7, lines 1-5); 

identifying stored media objects stored in the database that are related to the 
media object based upon the comparison (See column 4, lines 30-37; column 6, 
lines 1-8); 

inferring organization information for the media object based upon information 
obtained from each of the stored media objects related to the media object (See 
column 6, lines 16-24, where "inferring organization information" is read on 
"frame"); and 

organizing the media object in the database based upon the inference (See 
column 6, lines 22-25, lines 40-41). 
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As to claim 29, Bhandari et al. teaches a computer-readable medium 
having computer-executable instructions (See column 2, lines 40-44, where 
"computer-executable instructions" is read on "computer program") for performing 
the steps of: 

capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 
26-29, where "capturing a media object" is read on "images are input"); 
detecting attributes of the media object indicated in metadata for the media 
object (See column 4, lines 30-37; column 6, lines 4-20); 
performing an inexact search of the database based upon at least one of the 
attributes of the media object to identify stored media objects stored in the 
database that are related to the media object (See column 4, lines 30-37; column 
6, lines 1-8; column 7, lines 36-41); 

inferring organization information for the media object based upon information 
obtained from each of the stored media objects that are related to the media 
object (See column 6, lines 16-24, where "inferring organization information" is 
read on "frame"); and 

organizing the media object in the database based upon the inference (See 
column 6, lines 22-25, lines 40-41). 

As to claim 32, Bhandari et al. teaches a computer-readable medium 
having computer-executable instructions (See column 2, lines 40-44, where 
"computer-executable instructions" is read on "computer program") for performing 
the steps of: 
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capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 
26-29, where "capturing a media object" is read on "images are input"); 
comparing the media object with stored media objects that are stored in the 
database (See column 6, lines 62-63, where "comparing" is read on "matching" 
and where "feature" is read on "role matches" and " weight"; and see column 10, 
lines 12-17); 

identifying the stored media objects in the database that include features in 
common with the media object (See column 4, lines 30-37; column 6, lines 1-8; 
column 6, lines 62-63, where "identifying" is read on "matching" and where 
"feature" is read on "role matches" and " weight"; and see column 10, lines 12- 

17); 

inferring organization information for the media object based upon information 
obtained from each of the media objects including features in common with the 
media object (See column 6, lines 16-24, where "inferring organization 
information" is read on "frame"); and 

organizing the media object in the database based upon the inference (See 
column 6, lines 22-25, lines 40-41). 

As to claim 33, Bhandari et al. teaches a computer-readable medium 
having computer-executable instructions (See column 2, lines 40-44, where 
"computer-executable instructions" is read on "computer program") for performing 
the steps of: 
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capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 
26-29, where "capturing a media object" is read on "images are input"); 
identifying a feature of the media object (See column 4, lines 30-37; column 6, 
lines 1-8); 

comparing the feature of the media object with stored media objects that are 
stored in the database (See column 6, lines 62-63, where "comparing" is read on 
"matching" and where "feature" is read on "role matches" and " weight"; and see 
column 10, lines 12-17); 

identifying the stored media objects having the feature found in the media object 
(See column 6, lines 62-63, where "identifying" is read on "matching" and where 
"feature" is read on "role matches" and " weight"; and see column 10, lines 12- 
17); 

inferring organization information for the media object based upon information 
obtained from each of the stored media objects having the feature found in the 
media object (See column 6, lines 16-24, where "inferring organization 
information" is read on "frame"); and 

organizing the media object in the database based upon the inference (See 
column 6, lines 22-25, lines 40-41). 

As to claim 34, Bhandari et al. teaches a computer-readable medium 
having computer-executable instructions (See column 2, lines 40-44, where 
"computer-executable instructions" is read on "computer program") for performing 
the steps of: 
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capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 
26-29, where "capturing a media object" is read on "images are input"); 
identifying a feature of the media object (See column 4, lines 30-37; column 6, 
lines 1-8); 

performing an inexact search to detect stored media objects that are stored in the 

database having the feature identified in the media object (See column 4, lines 

30-37; column 6, lines 1-8; lines 4-20; column 7, lines 36-41); 

identifying the stored media objects having the feature identified in the media 

object (See column 6, lines 62-63, where "identifying" is read on "matching" and 

where "feature" is read on "role matches" and " weight"; and see column 10, lines 

12-17); 

inferring organization information for the media object based upon information 
obtained from each of the stored media objects having the feature identified in 
the media object (See column 6, lines 16-24, where "inferring organization 
information" is read on "frame"); and 

organizing the media object in the database based upon the inference (See 
column 6, lines 22-25, lines 40-41). 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described 
as set forth in section 102 of this title, if the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which 



Application/Control Number: 10/021,255 Page 16 

Art Unit: 2164 

said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

5. Claims 10, 27, and 35-41 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Bhandari et al. (U.S. Patent No. 5,865,464), in view of 
publication, "Software System for Automatic Albuming of Consumer Pictures," by 
Loiu et al. published by ACM Multimedia Conference, 1999 (hereinafter, Loui et 
al.. '99 ) 

As to claim 10, Bhandari et al. teaches a method of organizing media 
objects in a database (See column 2, lines 50-59, where "organizing media 
objects" is read on "'smart' archival and retrieval system"), comprising: 
capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 
26-29, where "capturing a media object" is read on "images are input"); 
determining attributes of the media object indicated in the metadata for the media 
object (See column 4, lines 30-37; column 6, lines 4-20); 
determining a date on which the media object was captured, wherein the date 
comprises one of the attributes of the media object (See column 4, lines 30-37; 
column 6, lines 1-8); 

inferring organization information for the media object based upon the 
comparison (See column 6, lines 16-24, where "inferring organization 
information" is read on "frame", and see lines 22-25, lines 40-41); and 
organizing the media object in the database based upon the inference (See 
column 6, lines 22-25, lines 40-41). 
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Bhandari et al. does not teach comparing the date on which the media 
object was captured with entries in a date book. 

Loui et al., '99 , teaches a software system for automatic albuming of 
consumer pictures (See abstract), in which he teaches comparing the date on 
which the media object was captured with entries in a date book (See page 160, 
section 2, lines 1-7, where "date book" is read on "comprehensive chronicle", 
lines 1 5-16; section 2.1 , lines 3-7). 

Therefore, it would have been obvious to a person having ordinary skill in 
the art at the time of the invention was made to have modified Bhandari et al. , to 
include comparing the date on which the media object was captured with entries 
in a date book. 

It would have been obvious to a person having ordinary skill in the art at 
the time the invention was made to have modified Bhandari et al. , by the 
teachings of Loui et al., '99 , because comparing the date on which the media 
object was captured with entries in a date book would create and develop a 
software system or application to enable the automatic organization and 
albuming of consumer images (See Loui et al., '99 , page 159, motivation section, 
lines 37-39). 

As to claim 27, Bhandari et al. teaches a computer-readable medium 
having computer-executable instructions (See column 2, lines 40-44, where 
"computer-executable instructions" is read on "computer program") for performing 
the steps of 
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capturing a media object (See column 3, lines 26-29; column 4, lines 4-9, lines 
26-29, where "capturing a media object" is read on "images are input"); 
determining attributes of the media object indicated in the metadata for the media 
object (See column 4, lines 30-37; column 6, lines 4-20); 
determining the date on which the media object was capture, wherein the date 
comprises one of the attributes of the media object (See column 4, lines 30-37, 
where "attributes" is read on "description"; column 6, lines 1-8); 
inferring organization information for the media object based upon the 
comparison (See column 6, lines 16-24, where "inferring organization 
information" is read on "frame"); and 

organizing the media object in the database based upon the inference (See 
column 6, lines 22-25, lines 40-41). 

Bhandari et al. does not teach comparing the date on which the media 
object was captured with entries in a date book. 

Loui et al., '99 , teaches a software system for automatic albuming of 
consumer pictures (See abstract), in which he teaches comparing the date on 
which the media object was captured with entries in a date book (See page 160, 
section 2, lines 1-7, where "date book" is read on "comprehensive chronicle", 
lines 15-16; section 2.1, lines 3-7). 

Therefore, it would have been obvious to a person having ordinary skill in 
the art at the time of the invention was made to have modified Bhandari et al. , to 
include comparing the date on which the media object was captured with entries 
in a date book. 
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It would have been obvious to a person having ordinary skill in the art at 
the time the invention was made to have modified Bhandari et aL , by the 
teachings of Loui et al., '99 , because comparing the date on which the media 
object was captured with entries in a date book would create and develop a 
software system or application to enable the automatic organization and 
albuming of consumer images (See Loui et al., '99 , page 159, motivation section, 
lines 37-39). 

As to claim 35, Bhandari et al. teaches a method of organizing media 
objects in a database (See column 2, lines 50-59, where "organizing media 
objects" is read on "'smart' archival and retrieval system"), comprising: 

detecting a capture time for each of the media objects to be organized 
(See column 4, lines 30-37, where "capture time" is read on "when image was 
taken"). 

Bhandari et al. does not teach sorting the media objects in based upon the 
capture time to generate a sorted list; comparing the capture time of each of the 
media objects with a reference value; and grouping the media objects in the 
database based upon the comparison. 

Loui et al., '99 , teaches a software system for automatic albuming of 
consumer pictures (See abstract), in which he teaches sorting the media objects 
in based upon the capture time to generate a sorted list (See page 160, section 
2.1, lines 3-7); 
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comparing the capture time of each of the media objects with a reference value 
(See page 160, section 2.1, paragraph 1, lines 3-27); and 
grouping the media objects in the database based upon the comparison (See 
page 160, section 2.1, paragraph 1, lines 3-4). 

Therefore, it would have been obvious to a person having ordinary skill in 
the art at the time of the invention was made to have modified Bhandari et al. , to 
include sorting the media objects in based upon the capture time to generate a 
sorted list; comparing the capture time of each of the media objects with a 
reference value; and grouping the media objects in the database based upon the 
comparison. 

It would have been obvious to a person having ordinary skill in the art at 
the time the invention was made to have modified Bhandari et al. , by the 
teachings of Loui et al., '99 , because sorting the media objects in based upon the 
capture time to generate a sorted list; comparing the capture time of each of the 
media objects with a reference value; and grouping the media objects in the 
database based upon the comparison would create and develop a software 
system or application to enable the automatic organization and albuming of 
consumer images (See Loui et al., '99 , page 159, motivation section, lines 37- 
39). 

As to claim 36, Bhandari et al. as modified, teaches determining whether 
the capture time of the each of the media objects is within a predetermined time 
period from the reference value (See Loui et al., '99 , page 160, section 2.1 
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System Features, lines 3-10); and wherein the grouping step comprises grouping 
at least one of the media objects into a collection when the capture time of the at 
least one of the media objects the media objects is within the predetermined time 
period from the reference value (See Loui et al., '99 , page 160, section 2.1 
System Features, lines 3-10; also see page 160, section 1. Event clustering, 
lines 3-7). 

As to claim 37, Bhandari et al. as modified, teaches selecting a 
representative media object from the at least one of the media objects grouped in 
the collection for use as a user interface (See Bhandari et al., column 7, lines 49- 
55; also see Loui et al., '99 , page 159, abstract section, lines 9-16; also see page 
161, section 2.2 Software Architecture, lines 41-45). 

As to claim 38, Bhandari et al. as modified, teaches repeating the 
comparing step, the grouping step and the selecting step for each of the media 
objects in the sorted list (See Loui et al., '99 , page 159, abstract section, lines 9- 
16). 

As to claim 39, Bhandari et al. as modified, teaches setting a reference 
value to a predetermined value (See Loui et al., '99, page 160, section 2.1, 1. 
Event Clustering, lines 17-25); determining whether the capture time of a first one 
of the media objects in the sorted list is within a predetermined time period from 
the reference value (See Loui et al.. '99, page 160, section 2.1 System Features, 
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lines 3-10; also see section 2.1, 1. Event Clustering, lines 17-25); grouping the 
first one of the media objects into a collection when the capture time of the first 
one of the media objects is within the predetermined time period from the 
reference value (See Loui et al. t '99, page 160, section 2.1 System Features, 
lines 3-10; also see page 160, section 2.1, 1.. Event Clustering, lines 17-25); 
updating the reference value to the capture time of the first one of the media 
objects in the sorted list to generate an updated reference value; and repeating 
the determining step, the grouping step and the updating step for each of the 
media objects in the sorted list (See Bhandari et al., column 7, lines 49-55; also 
see Loui et al., '99 , page 159, abstract section, lines 9-16). 

As to claim 40, Bhandari et al. as modified, teaches creating a new 
collection when the capture time of any one of the media objects from the sorted 
list is not within the predetermined time period from the updated reference value 
(See Bhandari et al. , column 7, lines 36-41). 

As to claim 41 , Bhandari et al. as modified, teaches selecting a 
representative media object from the collection and from each new collection for 
use as a user interface (See Loui et al., '99 , page 159, abstract section, lines 9- 
16; also see page 161, section 2.2 Software Architecture, lines 41-45). 



6. Claims 1 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Bhandari et al. (U.S. Patent No. 5,865,464), in view of publication, "Automatic 
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Image Event Segmentation and Quality Screening for Albuming Applications," by 
Loiu et aL published by IEEE International Conference on multimedia and Expo, 
2000 (hereinafter, Loui et aL '00 ). 

As to claim 1 1 , Bhandari et al. does not teach wherein the comparing step 
comprises: comparing the date on which the media object was captured with 
entries in a global date book. 

Loui et al. '00 , teaches automatic image event segmentation and quality 
screening for albuming applications (See abstract), in which he teaches wherein 
the comparing step comprises: comparing the date on which the media object 
was captured with entries in a global date book (See page 1 126, section II. 
Image Event Segmentation, lines 31-36; also see page 1126, section B. Block- 
based Histogram Correlation, lines 7-15). 

Therefore, it would have been obvious to a person having ordinary skill in 
the art at the time of the invention was made to have modified Bhandari et al. , to 
include wherein the comparing step comprises: comparing the date on which the 
media object was captured with entries in a global date book. 

It would have been obvious to a person having ordinary skill in the art at 
the time the invention was made to have modified Bhandari et aL , by the 
teachings of Loui et al. '00 , because wherein the comparing step comprises: 
comparing the date on which the media object was captured with entries in a 
global date book would help people organize their pictures so that they will be 
able to convey their story effectively (See Loui et al. '00 , page 1 125, section I. 
Introduction, lines 9-1 1 ). 
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7. Claim 28, is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Bhandari et al. (U.S. Patent No. 5,865,464), in view of Loui et al., '99 , as applied 
to claims 10, 27, 35-41 and 46 above, and further in view of publication, 
"Automatic Image Event Segmentation and Quality Screening for Albuming 
Applications/' by Loiu et al. published by IEEE International Conference on 
multimedia and Expo, 2000 (hereinafter, Loui et al. '00 ). 

As to claim 28, Bhandari et al. as modified, still does not teach comparing 
the date on which the media object was captured with entries in a global date 
book. 

Loui et al. '00 , teaches automatic image event segmentation and quality 
screening for albuming applications (See abstract), in which he teaches 
comparing the date on which the media object was captured with entries in a 
global date book (See page 1126, section II. Image Event Segmentation, lines 
31-36; also see page 1126, section B. Block-based Histogram Correlation, lines 
7-15). 

Therefore, it would have been obvious to a person having ordinary skill in 
the art at the time of the invention was made to have modified Bhandari et al. , to 
include comparing the date on which the media object was captured with entries 
in a global date book. 

It would have been obvious to a person having ordinary skill in the art at 
the time the invention was made to have modified Bhandari et al. . by the 
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teachings of Loui et al. '00 , because comparing the date on which the media 
object was captured with entries in a global date book would help people 
organize their pictures so that they will be able to convey their story effectively 
(See Loui et al. '00 , page 1125, section I. Introduction, lines 9-11). 

Response to Arguments 

8. Applicant's arguments filed on July 22, 2004, with respect to the rejected 
claims 1-41 have been fully considered but they are not found to be persuasive: 

In response to applicants' arguments regarding independent claims 1 and 
18, in which Bhandari et al. , does not teach or suggest "identifying media objects 
stored in the database that are related to the captured media object". Bhandari et 
al., teaches comparing the query to an archival multimedia object description 
(See column 10, lines 3-17). 

In response to applicants' arguments regarding independent claims 1 and 
18, in which Bhandari et al. , "lacks a teaching or suggestion of inferring 
organization information for the media object based upon information obtained 
from each of the stored media objects that are related to the {capture} media 
object ". Bhandari et al ., teaches comparing the query to an archival multimedia 
object description in order to find a match (See column 6, lines 16-24; column 10, 
lines 3-17). 

In response to applicants' arguments regarding independent claims 9 and 
26, in which Bhandari et al. , does not teach or suggest "comparing a date with 
threshold date information and identifying media objects stored in the database 
that are related to the media object based upon the caparison". Bhandari et al ., 
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teaches description fields and captions that are associated with each metadata, 
which include when the image was taken, creating a matching weight which is 
compared to a predetermined threshold weight (See column 4, lines 30-35; 
column 6, lines 54-67; column 7, lines 1-5). 

In response to applicants' arguments regarding dependent claims 12-14 
and 29-31 , in which Bhandari et al. t does not teach or suggest "performing any 
action on the captured media object after performing after performing this search, 
such as inferring organization information for the media object based upon 
information obtained from each of the stored media objects that are related to the 
media object; and organizing the media object in the database upon the 
interference". Bhandari et al ., teaches comparing the query to an archival 
multimedia object description in order to find a match (See column 6, lines 16-24; 
column 10, lines 3-17). 

In response to applicants' arguments regarding dependent claims 15 and 
32, in which Bhandari et aL , does not teach or suggest "comparing the media 
object with media objects that are stored in the database; inferring organization 
information for the media object based upon information obtained from each of 
the stored media objects that are related to the media object ". Bhandari et al ., 
teaches comparing the query to an archival multimedia object description in order 
to find a match (See column 6, lines 16-24; column 10, lines 3-17). 

In response to applicants' arguments regarding dependent claims 10 and 
27, in which Loui '99. , does not teach or suggest "comparing the date on which 
the media object was captured with entries in date book", Loui '99. , discloses 
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clustering images based on events and dates, in order for that to be possible the 
dates and events must be compared to each other (See section 2.1, p. 160, lines 
1-14). 

Therefore, claims 1-45 stand rejected. 

Conclusion 

9. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of 
time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire 
THREE MONTHS from the mailing date of this action. In the event a first reply is 
filed within TWO MONTHS of the mailing date of this final action and the advisory 
action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory 
action is mailed, and any extension fee pursuant to 37 CFR 1 .1 36(a) will be 
calculated from the mailing date of the advisory action. In no event, however, will 
the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

10. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Mellissa M Chojnacki whose telephone 
number is (571) 272-4076. The examiner can normally be reached on 9:00am- 
5:30pm. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Dov Popovici can be reached on (571) 272-4083. The fax 
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phone number for the organization where this application or proceeding is 
assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 



free). 
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